Drug Safety (2020) 43:1205-1210 
https://doi.org/10.1007/s40264-020-01002-6 


CURRENT OPINION 





Check for 
updates 


Assessing the Safety of COVID-19 Vaccines: A Primer 


Helen Petousis-Harris'!® 


Accepted: 10 September 2020 / Published online: 30 September 2020 
© Springer Nature Switzerland AG 2020 


Abstract 


Vaccines against COVID-19 are being developed at speeds not previously achieved. With this unprecedented effort comes 
challenges for post-marketing safety monitoring and challenges for vaccine safety communication. To deploy these new vac- 
cines fast across diverse populations, it is vital that robust pharmacovigilance and active surveillance systems are in place. 
Not all countries have the capability or resources to undertake adequate surveillance and will rely on data from those who 
can. The tools exist to assess COVID-19 vaccines as they are deployed such as surveillance systems, administrative data 
and case definitions for adverse events of special interest. However, stitching these all together and using them effectively 
requires investment and collaboration. This paper provides a high-level overview of some of the facets of modern vaccine 
safety assessment and how they are, or can be, applied to COVID-19 vaccines. 


Key Points 





COVID-19 vaccines are being developed at an unprec- 
edented speed leading to concerns about adequate safety 
assessments before deployment. 


There are many entities tasked with assessing and moni- 
toring vaccine safety at the global and national levels and 
prior experience in enhanced vaccine safety activities. 


We have the tools to intensively monitor and assess the 
safety of COVID-19 vaccines as they are deployed, pro- 
viding there is coordination and collaboration. 


1 Introduction 


An unprecedented commitment to developing and produc- 
ing vaccines against SARS-CoV-2 in record time is under- 
way and new candidates are entering clinical testing almost 
weekly. The speed at which development is unfolding has 
led to widespread concern among both health professionals 
and the public that vital steps may be skipped, in particular 
the assessment of safety. 
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Vaccine development has traditionally been a long process 
taking an average of 10-15 years. The vaccine with the short- 
est timeline from antigen discovery to licensure is the mumps 
vaccine, which took 4 years. It is the high financial cost, par- 
ticularly high-risk advanced clinical development, coupled 
with the investment in production facilities that has, in part, 
hampered nimble vaccine responses to emerging infectious 
diseases. However, recent developments in technology along 
with unprecedented collaboration and investment mean we 
may be able to escape the barriers of the past [1]. 

As well as the speed at which vaccine candidates were 
advanced, where possible the clinical development and regu- 
latory phases are occurring alongside each other rather than 
sequentially [2]. This means that while all steps are adhered 
to, their timing can be expedited. The desperate need for an 
Ebola vaccine galvanised us, and in less than 12 months, 
12 clinical trials ran the gamut from a “first in man” dos- 
ing study to a phase III efficacy trial [3]. This was achieved 
through successful collaborations and running these stages 
in parallel [4, 5]. However, while the pre-licensure clinical 
programme was executed in record time, fragile settings are 
often ill equipped for post-licensure safety surveillance. 


2 Pre-Clinical: Assessment in Animal Models 


Potential vaccine candidates need to be assessed in suitable 
animals for safety, immunogenicity and efficacy under chal- 
lenge. Translating data from any single animal to humans 
can be problematic as the disease may not mimic human 
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infection accurately, and therefore fail to predict vaccine 
effects, positive or negative. The models for assessing 
SARS-CoV-2 vaccines include mouse (transgenic for the 
human ACE2 receptor), hamster, ferret and non-human 
primates, depending on what question is being asked [6]. 
Studies of earlier SARS vaccines in animals identified 
two potential safety issues; antibody-dependent enhance- 
ment and cellular immunopathology. These have not been 
observed in human studies but flag potential responses for 
close examination and highlight the importance of select- 
ing vaccine approaches and adjuvants that drive desirable 
responses [7]. 


3 Pre-Licensure: Assessment in Humans 


Clinical studies in humans generally follow three phases. 
Phase I with 10’s (~ 30 to 50) of healthy volunteers assesses 
the safety, immunogenicity and dose ranging; phase II pro- 
gresses to 100’s of volunteers and assesses safety and immu- 
nogenicity; phase II includes 10,000’s of volunteers and 
assesses safety and efficacy. Phase III is usually placebo- 
controlled studies and while safety continues to be studied 
efficacy will be assessed. Normally, these phases progress 
sequentially after careful assessment of results of each stage 
before moving to the next. In the case of COVID-19 vac- 
cines, as with recent Ebola vaccines, these stages can be 
expedited without skipping anything thanks to investment 
and collaboration [2]. Each trial will have an independent 
drug safety monitoring board and ideally this group will have 
diverse expertise, including a biostatistician. For COVID- 
19 vaccines, it is recommended that there be persons with 
expertise in rare disease epidemiology. A meta-drug safety 
monitoring board has been established to ensure that high- 
level expertise is available to support all drug safety moni- 
toring boards [8, 9]. 


4 Agencies and Entities Tasked 
with Assessing and Monitoring Vaccine 
Safety 


4.1 World Health Organization Global Advisory 
Committee on Vaccine Safety 


Established in 1999, this committee of 14 experts from all 
regions of the world meets twice a year (and when needed) 
to assess the safety of vaccines. They provide independent, 
authoritative, scientific advice to the World Health Organi- 
zation (WHO) on vaccine safety issues of global or regional 
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concern. In May 2020, the Committee focussed on COVID- 
19 and discussed potential safety issues that may arise with 
the new vaccines being developed and deployed under the 
emergency conditions. The Committee also considered the 
work being undertaken by the Coalition for Epidemic Pre- 
paredness Innovation-funded Safety Platform for Emergency 
vACcines (SPEAC), issues around pharmacovigilance pre- 
paredness, and safety communication at a time when vac- 
cine hesitancy and misinformation are growing challenges. 
The key conclusions from this first meeting on COVID-19 
vaccines was that post-licensure surveillance preparedness 
at both country and regional levels was urgent and that man- 
aging the ‘infodemic’ was critical, supporting the proposed 
approach and roadmap to COVID-19 vaccine benefit-risk 
communication [10]. 


4.2 World Health Organization Strategic Advisory 
Group of Experts 


The Strategic Advisory Group of Experts is the principal 
advisory group to WHO for vaccines and immunisation. 
This 15-member group advises WHO on global policies 
and strategies, from vaccines and technology, research and 
development, to delivery of immunisation and its linkages 
with other health interventions. For vaccine safety, the 
Strategic Advisory Group of Experts takes the findings 
of the Global Advisory Committee on Vaccine Safety and 
makes recommendations. The Strategic Advisory Group of 
Experts are next meeting in October 2020 where COVID- 
19 vaccines will be considered and recommendations 
developed. 


4.3 Brighton Collaboration 


The Brighton Collaboration is an international collaboration 
launched in 1999 and tasked with developing definitions and 
guidelines for potential adverse events following immuni- 
sation [11]. Since 2019, the Brighton Collaboration have 
had a contract with the Coalition for Epidemic Preparedness 
Innovation to develop tools to guide developers, regulatory 
agencies and health authorities through safety evaluations 
of vaccines developed with new technologies. This is within 
the SPEAC project with the objective of harmonising safety 
assessments with standardised tools and definitions. Since 
COVID-19 emerged, they have increased their activities 
and are developing tools to help us assess COVID-19 vac- 
cines. These tools include templates for the different vac- 
cine platforms, and the development of adverse events of 
special interest (AESIs) likely to be pertinent to COVID-19 
vaccines. 
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4.4 Standardised Templates and Adverse Events 
of Special Interest 


The SPEAC working groups have developed templates 
that can be completed by vaccine developers/sponsors that 
describe the key considerations for risk benefit assessment. 
There are templates for viral vector vaccines [12], protein 
vaccines [13], nucleic acid vaccines [14] and AESIs [15]. 

An AESI is defined by the Council for International 
Organizations of Medical Sciences as: 


“An adverse event of special interest (serious or non- 
serious) is one of scientific and medical concern spe- 
cific to the sponsor’s product or program, for which 
ongoing monitoring and rapid communication by the 
investigator to the sponsor could be appropriate. Such 
an event might require further investigation in order 
to characterize and understand it. Depending on the 
nature of the event, rapid communication by the trial 
sponsor to other parties (e.g., regulators) might also 
be warranted.” [16] 


The SPEAC project has developed a list of AESIs for 
COVID-19 vaccines based on: proven association with 
immunisation; proven association with a vaccine platform 
and/or adjuvant relevant to Coalition for Epidemic Prepared- 
ness Innovation vaccine development; theoretical concern 
based on immunopathogenesis; theoretical concern related 
to viral replication during wild-type disease; and theoreti- 
cal concern because it has been demonstrated in an animal 
model with one or more candidate vaccine platforms [16]. 
These events and the definitions and guidelines on collect- 
ing and reporting them will be invaluable to support active 
safety surveillance and phase IV studies. 


4.5 Regulatory Agencies 


Regulatory agencies are tasked with having authority over 
safety to protect consumers. Examples include the US Food 
and Drug Administration and the European Medicines 
Agency. Vaccines must be evaluated and approved by a 
national regulatory authority before they can be used. The 
US Food and Drug Administration has issued guidance for 
industry on the development and licensure of vaccines to 
prevent COVID-19. It outlines key considerations needed to 
satisfy the regulators in their assessment of these vaccines. 
This covers the chemistry, manufacturing, manufacturing 
facilities, non-clinical data such as toxicology studies and 
animal models, clinical trials and plans for post-licensure 
evaluation [17]. The European Medicines Agency has also 
issued similar guidance [18]. These guidelines will also 
serve as a useful framework for other nations in their deci- 
sion making. 
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4.6 Country-Level Pharmacovigilance Systems 
and Passive Surveillance 


Most countries have a passive surveillance system for 
recording and reporting on adverse events following immu- 
nisation and in turn report to the WHO pharmacovigilance 
centre in Uppsala, Sweden. The WHO Global Vaccine 
Safety Blueprint I considers a minimum reporting rate of 
10 per 100,000 population for functional adverse events fol- 
lowing an immunisation surveillance system [19]. In 2017, 
114 countries met or exceeded this objective [20]. How- 
ever, while safety capacity has improved in many low-and 
middle-income countries, others still face challenges with 
low detection rates and reporting, the investigation of safety 
signals, lack of epidemiological tools for active surveil- 
lance, challenges at the national regulatory authority level, 
and a lack of information sharing between countries. When 
optimised, these systems have demonstrated their value in 
detecting unexpected or rare events but limitations such as 
the lack of a denominator and reliance on voluntary reports 
mean they cannot be relied on for detection and they cannot 
be used for causality assessment. There are also significant 
deficiencies in global-level reporting with over half of the 
total reports in 2017 received from the USA, UK, France, 
China and the Republic of Korea [21]. Many reports are not 
timely with an average of 2.4 years between event onset and 
report date. These limitations will clearly limit or prevent 
the generation of COVID-19 vaccine-related safety signals 
in most countries. 


4.7 Active Safety Surveillance and Phase IV Studies 


Some countries have systems that can monitor events in at 
least some of their population in near real time and map to 
vaccine exposure. A larger number of countries can assess 
potential safety events retrospectively. Examples of advanced 
systems include the US Vaccine Safety Datalink [22, 23] and 
the European ADVANCE [24]. The ADVANCE project has 
led to a sustainability project called VAC4EU, which will 
support the European Medicines Agency-funded COVID- 
19 vaccine monitoring programme called ACCESS. While 
these systems have demonstrated their ability to undertake 
robust assessments, they are not globally representative, are 
restricted to locally used vaccines, and the population sizes 
under observation lack the power to assess very rare events 
such as Guillain-Barre Syndrome. These limitations can be 
overcome through global collaboration [25]. 

Distributed networks allow individual countries (or sites) 
to collaborate. These collaborations pull multiple countries 
together to conduct studies on huge numbers of people using 
administrative data and can compare the risks for very rare 
events between vaccinated and unvaccinated people. Such 
collaborations have occurred in the past, pooled data from 


A Adis 


1208 


several countries were used to assess measles-containing vac- 
cines and aseptic meningitis and idiopathic thrombocytopenic 
purpura [26, 27], rotavirus vaccines and intussusception [28], 
and the pandemic influenza vaccine and Guillain—Barre syn- 
drome and narcolepsy [29]. However, all these studies were 
ad hoc, with no sustainable network in place. The capacity 
exists globally to assess vaccine safety. The development of 
this capacity is critical for the ongoing assessment of COVID- 
19 vaccine safety but as yet lacks investment [25]. 


5 Challenges and Solutions for the Safe 
and Responsible Deployment of COVID-19 
Vaccines 


Too few countries have high functioning pharmacovigilance 
systems, and far fewer are able to undertake robust signal 
verification and post-licensure studies on safety. These coun- 
tries will need to rely on data generated by those who do have 
the capability, perhaps placing some further ethical obliga- 
tions on those countries who can, rather than rely on the 
predominant data contributions from Europe and the USA. 
Adverse events will coincide temporally with vaccine 
administration [30]. Prior to the use of COVID-19 vaccines, 
it is important to understand the background rates of condi- 
tions that may be temporally associated with vaccine admin- 
istration to be able to assess observed rates vs the expected 
rates [31]. For most events, these rates are unknown and to 
further complicate matters the rates of many events, such 
as multiple sclerosis, vary by sex and geography [32, 33]. 
Developing background rates for COVID-19 vaccine AESIs 
for as many populations as possible is a matter of urgency. 
Deploying any new vaccine based on data from expedited 
clinical trials into a population without a functioning safety 
monitoring system in place is reckless and irresponsible given 
the tools that are available. While there are international col- 
laborations aimed at supporting coordinated efforts in COVID- 
19 vaccine safety assessments, vaccine nationalism and a lack 
of a globally coordinated vaccine safety effort could limit 
the potential in this space. Furthermore, deployment of vac- 
cines before the successful completion of robust clinical pro- 
grammes could threaten not only public confidence in COVID- 
19 vaccines but also immunisation programmes in general. 
While the clinical testing of COVID-19 vaccines can be 
done robustly and assessment by regulatory agencies can be 
stringent, the vaccines are likely to be used under emergency 
conditions and the follow-up time from the trials will be 
minimal. Under such conditions, it is vital that the products 
are monitored (in near real time) for rare adverse events until 
risks can be either quantified or excluded (see Box for a case 
study). Only a few countries have the capability to conduct 
this monitoring [34] and even fewer are prepared with sys- 
tems at the ready and baseline rates of AESIs established. 


A Adis 


H. Petousis-Harris 


There is an urgency to support as many sites as possible to 
prepare in collaboration with each other to actively moni- 
tor COVID-19 vaccines as they are deployed using com- 
mon protocols so that data may be pooled, and rare events 
assessed in diverse populations. 

We have the tools to intensively monitor the safety of 
COVID-19 vaccines. While billions are being spent on the 
development and scale manufacturing of vaccines that have 
yet to demonstrate efficacy, with the exception of the Euro- 
pean Union, there is limited investment in the post-licensure 
phase yet, which is inexpensive in comparison. Failure to 
assess these vaccines for safety to our full ability is wrong. 
As we well know from extensive experience, vaccine safety 
issues can threaten not only the success of any COVID-19 
vaccine programme but also routine immunisation pro- 
grammes. It is vital we get this right and we have the tools 
and the expertise to do so and to do it well. 


5.1 Rolling Out a Vaccine with Limited Clinical 
Data Case Study: The New Zealand MeNZB 
Vaccine 


During the 1990s and into the 2000s, New Zealand 
had a devastating meningococcal B disease epidemic. 
There was no suitable existing vaccine available, so a 
tailor-made outer-membrane vesicle vaccine was devel- 
oped through a collaboration (New Zealand Govern- 
ment, University of Auckland, Norwegian Institute 
of Public Health, The Institute of Environmental and 
Research, and industry). It was tested in New Zealand 
in phase I, II and IIb trials then rolled out to the high- 
est risk members of the New Zealand population after 
only a few thousand people had received the vaccines 
(for meningococcal vaccines, immunogenicity bridging 
data may be used for licensure as phase III trials are not 
feasible because of the rarity of the disease outcome). 

To do this safely, a multi-faceted, intensive, post- 
licensure safety surveillance strategy was implemented 
[35]. All people in the age group receiving the vaccine 
who went to hospital were assessed for their vaccine 
exposure [35]. Additionally, a proportion of primary 
care practices provided data on visits so that exposure 
to the vaccine could be assessed [36]. Weekly screen- 
ing occurred against background rates (observed vs 
expected). An electronic national immunisation register 
made comparisons between vaccinated and unvacci- 
nated people possible to detect any safety signals. This 
happened in near real time and provided high-quality 
data that provided reassurance about the vaccine’s 
safety profile. Since this occurred in 2004—6, informa- 
tion technology has progressed, as have methodologies 
in pharmacoepidemiology, which make such systems 
cheaper and more feasible to implement. 
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